Skip to main content

A/Z Testing

A/Z Testing lets you create multiple versions of the same email sequence.

Each variation can have different:

  • Subject lines
  • Email content
  • Follow-up emails

When your campaign starts, Deliveryman AI automatically distributes your contacts across all variations.

Each contact receives only one variation, ensuring your test results remain accurate.

Deliveryman AI - A to Z Testing

How A/Z Testing Works​

  1. Create your campaign.
  2. Add multiple variations to each sequence step.
  3. Launch the campaign.
Deliveryman AI - A to Z Testing Deliveryman AI - A to Z Testing

DeliverymanAI randomly assigns contacts to each variation. Every contact stays in the same variation for the entire sequence. Analytics are recorded separately for every variation. Compare the results and identify the best-performing variation.

Why Should You Use It?​

Every cold email campaign can be improved.

A/Z Testing helps you:

  • Find the subject line that gets more opens.
  • Learn which email content gets more replies.
  • Discover which CTA encourages more responses.
  • Test new ideas without risking your entire campaign.
  • Improve future campaigns using real performance data.

Over time, these small improvements can lead to significantly better campaign performance.

What Can You Test?​

You don't have to rewrite your entire sequence.

Some common things to test include:

Subject Lines​

Try different ways of getting attention.

Example:

  • Quick question
  • Can I help with...
  • Idea for your team

Email Content​

Experiment with:

  • Short vs. long emails
  • Different value propositions
  • Different writing styles
  • Different levels of personalization

Call-to-Action​

A small change in your CTA can improve reply rates.

For example:

  • Interested?
  • Worth a quick chat?
  • Should I send more details?

Follow-up Emails​

Sometimes the follow-up performs better than the first email.

Test different follow-up messages, timing, or CTAs.

Understanding the Results​

Campaign analytics show how each variation performs.

You can compare metrics such as:

  • Open Rate
  • Reply Rate
  • Click Rate

The winning variation depends on your campaign goal.

For example:

  • Want more people to open your emails? Focus on Open Rate.
  • Want more conversations? Focus on Reply Rate.
  • Want more website visits? Focus on Click Rate.

Frequently Asked Questions​

How many variations can I create?​

You can create multiple variations within the same campaign. This allows you to test different messaging ideas without creating separate campaigns.

Will a contact receive more than one variation?​

No. Each contact is assigned to one variation only. They will continue through the entire sequence using that same variation.

Can I edit a variation after launching the campaign?​

Yes. But we recommend finalizing all variations before launching. Editing a variation after contacts have already been assigned may affect the accuracy of your results.

How do I choose the winning variation?​

Compare the analytics for each variation. The winner is usually the variation that performs best based on your campaign goal, whether that's more opens, replies, or clicks.

Can I disable a variation?​

Yes. You can disable any variation at any time. Once disabled, it cannot be enabled again, so make sure you've reviewed its performance before disabling it.

How many variations should I test?​

For most campaigns, testing 2–4 variations is a good starting point. Too many variations divide your audience into smaller groups, making it take longer to reach meaningful results.

Should every variation be completely different?​

Not necessarily. The best tests usually change only one important element, such as the subject line or CTA. This makes it easier to understand what improved your results.

Best Practices​

Test One Change at a Time​

If you change the subject line, email body, and CTA together, it becomes difficult to know what caused the improvement. Start with one major change per variation.

Give Every Variation Enough Data​

Don't decide after only a few emails. Allow enough contacts to receive each variation before comparing results.

Wait for Replies​

Replies often arrive several days after an email is sent. Give your campaign enough time before choosing a winner.

Keep Improving​

Finding one winning variation doesn't mean you're finished. Continue testing new ideas to improve your campaigns over time.